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ABSTRACT 


Aim: The aim of the paper is to present an overview of recent developments in fuzzy divergence measures. 

Methodology: We analysis some of well-known notions and the concepts associated with fuzzy set theory with an axiomatic 
definition of fuzzy divergence measure. 

Results: Fuzzy divergence measures and their generalizations existing in the literature are summarized briefly. 

Conclusion: The reviewed divergence measures and their generalizations are useful for further development of measures of 
divergence and appropriate to deal with different areas. 
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INTRODUCTION 

In 1965, as a generalization of classical (crisp) set theory, 
Zadeh [1] first proposed the concept of fuzzy set theory. It 
was found to be suitable in dealing with many fields like pat¬ 
tern recognition, image processing, speech recognition, bio¬ 
informatics, fuzzy aircraft control, feature selection, decision 
making, etc. Over the last six decades, the study on fuzzy 
set (FS) theory and its application to different area has been 
extended evenly by the researchers. Afterwards, in 1965, Za¬ 
deh [2] introduced the notion of fuzzy entropy as a measure 
of uncertainty. In 1972, De Luca and Tennini [3] presented 
an axiomatic composition of fuzzy entropy corresponding to 
the probabilistic entropy measure of Shannon [4], For de¬ 
termining the difference between the two FSs divergence 
measure is a significant tool among the most exciting meas¬ 
ures in FSs theory. The concept of fuzzy divergence meas¬ 
ure is itself one of the generalization of fuzzy information 
measure. Analogous to Kullback and Leibler [5] measure of 
divergence, Bhandari and Pal [6] introduced the fuzzy di¬ 
vergence measure. Thereafter literature on fuzzy measures 
of information, divergence and their generalizations are con¬ 
siderably extended by the different researchers [7-25] in the 
past decades. 


Briefly motivated by the study of the literature on measures 
of fuzzy information and their generalization in the paper 
Methodology section introduce some well-known concepts, 
and the notation related to fuzzy set theory, axiomatic defini¬ 
tions of fuzzy information measure, fuzzy divergence meas¬ 
ure etc. In the results section, we provide an overview of 
recent developments in fuzzy divergence measures and their 
generalizations. An essential analysis of the existing meas¬ 
ures of divergence is presented in the discussion section. The 
final section concludes the paper. 

METHODOLOGY 

We now introduce some of well-known notions and the con¬ 
cepts associated with fuzzy set theory with an axiomatic 
definition of fuzzy divergence measure. 

Zadeh [1] defined a fuzzy set (FS) A on a universe of dis¬ 
course U having the membership function n x : U [0,1] as 
follows: 

X ={(o,// J (fl)}/fle {/} 

The membership value Ux( a ) describes the degree of the 
belongingness of ae U in X. When Ux( a ) is valued in {0, 
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1}, it is the characteristic function of a crisp (i.e., non-fuzzy) 
set. 


The measure of difference between two fuzzy sets is called 
the fuzzy divergence measure. 

Bhandari and Pal [6] initiated the measure of fuzzy diver¬ 
gence corresponding to divergence measure of Kullback and 
Leibler [5], as 


HA:B) = 


1 


74 4,) log 


i=1 


UA(Oj) 

U B ( a i) 


+ 0-/4( fl <))log 


l~A.i(A,) 

1 — Ag ( a i) 


( 1 ) 


satisfying the conditions: 


I (A : B) > 0 


I(A:B) = 0ifA = B 


I(A: B) is a convex function of B a ( a i ) ■ 

Bhandari and Pal [6] also defined the fuzzy symmetric diver¬ 
gence measure: 


J(A:B)=I(A:B) + I(B:A) = 
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RESULTS 


A general study of the axiomatic definition of a divergence 
measure for fuzzy sets was also presented in Bouchon-Me- 
unier et al. [26]. As a significant content in fuzzy mathemat¬ 
ics, the research on divergence measures between fuzzy sets 
has received more attention. In recent years, some defini¬ 
tions of generalized measures of fuzzy divergence have been 
proposed. 


Afterwards, Shang and Jiang [27] provided a modified ver¬ 
sion of the fuzzy divergence measure of Bhandari and Pal [6] 
with the novel idea of Lin [28] and defined as 


D(A:B) 





(3) 


Fan and Xie [29] proposed the fuzzy infonnation of discrim¬ 
ination of A against B corresponding to the exponential 
fuzzy entropy of Pal and Pal [30] and is given by 


: 5) = X [l - ( 1 - ^ («,)) (a,.) e ( ^ » ] (4) 

Thereafter Couso et al. [31] define that if X is a universe of 
discourse and F(X) is the set of all fuzzy subsets, a mapping 
D:F(X)xF(X)->R is a divergence measure between fuzzy 
subsets if and only if for eachd,ft,CG F(X), the following 
axioms hold: 


d 1 :D(A:B) = D(B:A) 
d 2 : D(A :A) = 0 

d 3 :max{D(AuC:BuC),D(AnC:BnC)}<D(A:B) 

Non-negativity of D(A: B) is the natural assumption. 

Montes et al. [32] studied the special classes of divergence 
measures and used the link between fuzzy and probabilistic 
uncertainty. It also studied widely the divergence measure 
for fuzzy sets as a particular case. 

Hooda [33] presented a fuzzy divergence measure corre¬ 
sponding to Havada-Charvat [34] measure of divergence 
which is given by 

(5) 

Parkash et al. [35] proposed a fuzzy divergence measure 
corresponding to Ferreri [36] probabilistic measure of diver¬ 
gence given by 
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and another one given by Parkash et al. [35] is 

4 2 (T:S) = X 
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Corresponding to Renyi [36] and Sharma and Mittal [37] 
generalized measure of divergence Bajaj and Hooda [38] 
provided the generalized fuzzy divergence measure which 
are given by 

Dp(A,B) 


and D a p(X, Y) 

, n 1 1 

2 - 1 1=1 

erAl,a>0,/?/l,/J>0. (9) 


DISCUSSION 

Singh and Tomar [39, 40,41,42] have defined and studied 
some of symmetric and non-symmetric fuzzy divergence 
measures analogous to probabilistic divergence measures 
and inequalities among them. Moreover, Singh and Tomar 
[43,44] presented a number of refinement of inequalities 
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among fuzzy divergence measures. Bhatia and Singh [45] 
proposed three families of fuzzy divergence. 

Thereafter, Hooda and Jain [46] presented a generalized 
fuzzy divergence measure, its ambiguity and information 
improvement. Further, in the recent years, fuzzy measures of 
information, divergence and their generalizations are consid¬ 
erably extended by Tomar and Ohlan [17-20 ] and Ohlan and 
Ohlan [9-16] and Ohlan [7,8, 21-25] and find their applica¬ 
tions emerging in various fields like decision making (e.g., 
multi-criteria decision making, multi-attribute decision mak¬ 
ing), pattern recognition, medical diagnosis and suitability in 
linguistic variables. 

CONCLUSION 

In this paper we have presented a review of the fuzzy meas¬ 
ures of divergence and their generalizations existing in the 
literature. It was noted that these measures of fuzzy diver¬ 
gence can be used for further development of generalized 
fuzzy divergence measures, appropriate to deal with differ¬ 
ent areas. 
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